Discriminant Analysis through a Semiparametric Model
نویسنده
چکیده
We consider a semiparametric generalisation of normal-theory discriminant analysis. The semiparametric model assumes that, after unspecified univariate monotone transformations, the class distributions are multivariate normal. We introduce an estimation procedure based on the distribution quantiles, in which the parameters of the semiparametric model are estimated directly without estimating the nonparametric transformations. The procedure is computationally fast and the estimation accuracy is shown to have the usual parametric rate. The relationship between the method and more general nonparametric discriminant analysis is discussed. The semiparametric specification of the class densities is a submodel of the nonparametric log density functional analysis of variance model in which the main effects are completely nonparametric but the interaction terms are specified semiparametrically. Simulations and real examples are used to illustrate the procedure. Some key words: Distribution quantile; Linear discriminant analysis; Monotone transformation; Naive Bayes method; Nonparametric functional analysis of variance model; semiparametric discriminant analysis.
منابع مشابه
Semiparametric Sparse Discriminant Analysis in Ultra-High Dimensions
In recent years, a considerable amount of work has been devoted to generalizing linear discriminant analysis to overcome its incompetence for high-dimensional classification (Witten & Tibshirani 2011, Cai & Liu 2011, Mai et al. 2012, Fan et al. 2012). In this paper, we develop high-dimensional semiparametric sparse discriminant analysis (HD-SeSDA) that generalizes the normal-theory discriminant...
متن کاملSparse semiparametric discriminant analysis
In recent years, a considerable amount of work has been devoted to generalizing linear discriminant analysis to overcome its incompetence for high-dimensional classification (Witten and Tibshirani, 2011, Cai and Liu, 2011, Mai et al., 2012 and Fan et al., 2012). In this paper, we develop high-dimensional sparse semiparametric discriminant analysis (SSDA) that generalizes the normal-theory discr...
متن کاملFast Discriminative Component Analysis for Comparing Examples
Two recent methods, Neighborhood Components Analysis (NCA) and Informative Discriminant Analysis (IDA), search for a class-discriminative subspace or discriminative components of data, equivalent to learning of distance metrics invariant to changes perpendicular to the subspace. Constraining metrics to a subspace is useful for regularizing the metrics, and for dimensionality reduction. We intro...
متن کاملIndependent factor discriminant analysis
In the general classification context the recourse to the so-called Bayes decision rule requires to estimate the class conditional probability density functions. In this paper we propose a mixture model for the observed variables which is derived by assuming that the data have been generated by an independent factor model. Independent factor analysis is in fact a generative latent variable mode...
متن کاملCredit Scoring using Semiparametric Methods
Credit scoring methods aim to assess credit worthiness of potential borrowers to keep the risk of credit loss low and to minimize the costs of failure over risk groups. Standard parametric approaches as logistic discrimination analysis assume that the probability of belonging to the group of ”bad” clients is given by P (Y = 1|X) = F (βX), with Y = 1 indicating a ”bad” client and X denoting the ...
متن کامل